# Multi-task fine-tuning optimization

This is a hierarchical SLERP merged model based on multiple excellent open-source models (including OpenHermes-2.5, neural-chat-7b, MetaMath-Mistral-7B, and openchat-3.5), designed to serve as a powerful foundation model for various downstream tasks.

The Baby Llama model is a language model with 58 million parameters, distilled from LLaMA and GPT2, and designed specifically for the Small Language Model Challenge.